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Experiments are made with the Markov chain presented by the children's game of 
Chutes and Ladders. Statistics, such as the average length of play, are computed on the 
IBM 704 from 2 14 simulated plays of the game. These Monte Carlo results are then com- 
pared with the "exact solution" obtained by powering the matrix of transition probabilities. 
Convergence is shown to obey the familiar "Sf~ 1/2n law. 



1. Introduction 

Since Monte Carlo methods are generally applied 
to problems that are loo difficult for other types of 
analysis there is seldom opportunity to compare 
their results with " exact solutions." In this paper 
experiments are described with the Markov chain 
presented by the children's game of Chutes and 
Ladders. 1 Jn particular, the calculation of the aver- 
age length L of a play of this game is considered. 
An exact value for L is found according to Markov 
chain theory. The Monte Carlo calculation for L 
involves 2 14 simulated plays of the game. Further- 
more, the probabilities of being in a given state by 
a fixed number of throws are computed theoretically 
and experimentally. 

It is shown that well-known theorems of statistics 
imply that the Monte Carlo results should converge 
to the true solutions by il N~ % " laws. Numerical 
values are shown to follow these laws. All work was 
carried out on the IBM 704 computer. 

2. Description of the Game 

First the game of Chutes and Ladders is described 
in detail. The game is considered to be played in its 
solitaire form. The game involves a playing piece, 
one die, and a playing board which has squares 
numbered from 1 to 100. Certain pairs of these 100 
squares are connected by "chutes" and others are 
connected by "ladders." The purpose of the chutes 
is to delay the game by forcing the player to return 
to the square at the bottom of a chute if he should 
land on the square at its top. On the other hand, the 
ladders speed up the game by permitting a player to 
advance directly from the square at the bottom of a 
ladder to the square at its top, and thus bypass the 
squares in between. There are 10 chutes connecting 
the pairs of numbered squares (16,6), (47,26), (49,11), 
(56,53), (62,19), (64,60), (87,24), (93,73), (95,75), 
and (98,78). However, nine ladders connect the 
squares (1,38), (4,14), (9,31), (21,42), (28,84), 
(36,44), (51,67), (71,91), and (80,100). 



1 Copyright Milton-Bradley Co. 



Since the playing piece can never renin in at either 
the top of a chute or the bottom of a ladder, there 
are only 81 squares at which it can stop. 

The playing piece is off the board at the start of 
the game and the player tosses the die so as to deter- 
mine a number from 1 to 6. He then moves his 
playing piece through the same number of squares as 
the number on the die. Should his playing piece stop 
at the bottom of a ladder he must immediately move 
to the top of the ladder. He then repeats the throw 
of the die and moves accordingly. If at any time 
he lands at the top of a chute he must proceed directly 
to its bottom before the next die toss. The game is 
concluded when the playing piece reaches square 100. 
The board actually has two winning positions, 
since there is a ladder from square 80 to square 100. 
One requirement is that square 100 be reached by an 
exact throw of the die. 

3. Theoretical Solution 

The game can be interpreted as a finite Markov 
chain with 82 states. These states are indexed by 
i=0, 1, . . ., 81, where the state ^=0 corresponds 
to the starting position and the state i=81 corre- 
sponds to the playing piece being at square 100. All 
squares except those at the top of a chute or the 
bottom of a ladder have a corresponding state in 
the chain. 

Let Xi(ri), i=0, 1, . . ., 81 represent the prob- 
ability of being in state i after n throws of the die. 
Then X (0) = 1 and X (n) = for n>0. Also, 

81 

2 X i {n) = \ for every n>0. Let p t j be the condi- 

i=0 

tional probability of moving from square i to square j 
on one die toss whenever square i is occupied. We 
see immediately that 

[Prob of state"! 
j on n tosses J 



81 
i=0 



Prob of transition" 
from state i to 
_state j on one toss_ 



tProb of state % 
on 7i— 1 tosses _ 



(3.1) 
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In other words, the elements Xj(n) satisfy the 
relations 



si 0<j<81 

■Xi(n)=SP«X«(n-l) f 

1=0 »= 1,2,3, . 



(3.2) 



where X,(0)=- 



0, l<i<81 

1, i=0 



If we let X(n) be a 



row vector whose components are Xj(n) we can 
write (3.2) in the form 



X(n)=X(n-l)P=X(0)P n 



(3.3) 



where X(0) is the vector whose components are 
X (0), -Yi(0), . . ., X 81 (0) and P n is the nth power of 



^OQ* Poly 



LPsuo, Psi.u 



Po.Sl 



jP81.8lJ 



The matrix elements p tj will be called the transition 
probabilities; certain of them are given in table 1. 

We now consider the average length, L, of the 
game. This may be computed from the expression 



I=SwKiW-i 8 i(w-i)L 



(3.4) 



where the term Xgi(n)— X 81 (n— 1) represents the 
probability of reaching the final square on die toss 
number n. 

An alternative expression which can be used for 
computing L is given as follows. First introduce the 
truncated matrix P T formed by crossing out both the 
last row and the last column of P. Then form the 
matrix 

T=(I-P T )-> (3.5) 



Table 1. Partial listing of matrix elements p,, 



10 11 12 13 14 
1/6 
1/6 
1/6 



012345678 

1/6 1/6 1/6 1/6 

1 1/6 1/6 1/6 1/6 1/6 

2 1/6 1/6 1/6 1/6 

3 1/6 1/6 1/6 1/6 1/6 

4 1/6 1/6 1/6 1/6 1/6 

5 1/6 1/6 1/6 1/6 1/6 

6 1/6 1/6 1/6 1/6 1/6 

7 1/6 1/6 1/6 1/6 1/6 1/6 

8 1/6 1/6 1/6 1/6 1/6 1/6 

9 1/6 1/6 1/6 1/6 1/6 1/6 

10 1/6 1/6 1/6 1/6 1/6 

11 1/6 1/6 1/6 1/6 

12 1/6 1/6 1/6 

13 1/6 
14 



69 70 71 72 73 74 75 76 77 78 79 80 81 



66 
67 
68 
69 
70 
71 
72 
73 
74 
75 
76 
77 
78 
79 
80 
81 



1/6 1/6 1/6 
1/6 1/6 1/6 1/6 
1/6 1/6 1/6 1/6 1/6 

1/6 1/6 1/6 1/6 1/6 

1/6 1/6 1/6 1/6 1/6 

1/6 1/6 1/6 1/6 1/6 

1/6 1/6 1/6 1/6 1/6 
1/6 1/6 1/6 1/6 

1/6 1/6 1/6 1/6 

1/6 1/6 1/6 1/6 
1/6 1/6 1/6 

1/6 1/6 1/6 1/6 

1/3 1/6 1/6 1/6 

1/2 1/6 1/6 

5/6 1/6 

1 
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with elements Ty. It is shown on p. 329 of Kemeny, 
Snell, and Thompson 2 that L is given by 



80 



(3.6) 



which is simply the sum of the first row of the matrix 

Equation (3.3) shows that a direct numerical 
solution by successive matrix vector multiplications 
can be used to calculate the vectors X(n). This 
solution may not be feasible for full matrices or for 
chains with a large number of states, since powering 
the matrix may be subject to space and time limita- 
tions and roundoff error. However, for Chutes 
and Ladders only 476 of the 6,724 transition prob- 
abilities do not vanish. The X(n) were easily cal- 
culated on the IBM computer by taking the sums in 
(3.2) over the nonvanishing elements. The time 
required for each matrix vector multiplication was 
about 2 sec. To illustrate the results we have 
presented the vectors X(7) and -XT(31) in table 2. 
The vector X(7) is of interest since the computations 
showed that X 8l (n) = for n<C7, so that the game 
cannot be completed in fewer than seven throws; the 
vector X(31) is of interest since X 81 (31) has also 
been computed by Monte Carlo. 

Table 2. The vectors X{7) and X(31) 



i 


Xi(7) 


X t (31) 


i 


XiO) 


Xi(31) 











41 


. 15936X10-1 


.62209X10- 2 


1 








42 


.88735X10-2 


.37065X10-2 


2 








43 


. 16175X10-1 


.74137X10-2 


3 








44 


.95950X10-2 


.42890X10-2 


4 


. 19740X10- 1 


. 32552X10-2 


45 


.79733X10-2 


.37599X10-2 


5 


. 47725X10- 2 


. 56622X10-3 


46 


.71266X10-2 


.33331X10-2 


6 


.60942X10- 2 


.66476X10-3 


47 


.81697X10-2 


.39130X10-2 


7 


. 76982X10-2 


.78046X10-3 


48 


.78589X10-2 


.39497X10-2 


8 


. 28607X10-1 


.81893X10-2 


49 


.92057X10-2 


.73498X10-2 


9 


. 14518X10-1 


. 23394X10-2 


50 


.50654X10-2 


.38812X10-2 


10 


. 13064X10-1 


.21801X10-2 


51 


.40509X10-2 


.39027X10-2 


11 


. 14489X10-1 


.24607X10-2 


52 


.20898X10-2 


.33210X10-2 


12 


. 16036X10-1 


.27729X10-2 


53 


. 12610X10-2 


.32115X10-2 


13 


. 17811X10-1 


.31194X10-2 


54 


.12867X10-1 


.74863X10-2 


14 


. 17300X10-1 


.22388X10-2 


55 


.21219X10-2 


.31170X10-2 


15 


. 22630X10-1 


.61242X10-2 


56 


.24970X10-2 


.36590X10-2 


16 


. 21066X10-1 


. 29082X10-2 


57 


.27328X10-2 


. 36162X10-2 


17 


. 19726X10- 1 


.25041X10-2 


58 


.31579X10-2 


.36672X10-2 


18 


.24366X10-1 


.28399X10-2 


59 


.71766X10-2 


. 11658X10-1 


19 


. 30696X10-1 


. 12958X10-1 


60 


.26578X10-2 


.44668X10-2 


20 


. 26285X10-1 


.47659X10-2 


61 


.55870X10-2 


. 12502X10-1 


21 


. 50694X10"! 


. 12747X10-1 


62 


.25184X10-2 


. 62322X10-2 


22 


.27156X10-1 


.62357X10-2 


63 


.21969X10*2 


.66853X10-2 


23 


.26149X10-1 


.68824X10-2 


64 


.30328X10-2 


. 14594X10-' 


24 


. 24306X10-1 


. 75654X10-2 


65 


.18754X10-2 


.97370X10-2 


25 


. 29653X10-1 


. 74122X10-2 


66 


.82519X10-3 


.86279X10-2 


26 


. 22534X10-1 


. 70915X10-2 


67 


.42867X10-3 


.79559X10-2 


27 


. 18558X10"! 


. 61091X10-2 


68 


.26792X10-3 


.82531X10- 2 


28 


. 17693X10-1 


.60876X10-2 


69 


.30950 X10" 1 


.15841X10-' 


29 


. 20294X10" 1 


. 71449X10-2 


70 


.42081X10-2 


.87403X10-2 


30 


. 16547X10-1 


. 58783X10-2 


71 


.47404X10-2 


. 85657X10-2 


31 


. 14025X10-1 


. 56122X10- 2 


72 


.53905X10-2 


.85535X10-2 


32 


. 12767X10" 1 


. 53557X10- 2 


73 


.61050X10-2 


.86556X10-2 


33 


. 11956X10-1 


. 52252X10-2 


74 


.68837X10-2 


.87243X10-2 


34 


. 11335X10-1 


. 50757X10- 2 


75 


.67873X10-2 


. 11733X10-1 


35 


.33790X10-1 


. 77028X10-2 


76 


.38437X10-2 


. 80086X10-2 


36 


. 17929X10-1 


. 60554X10-2 


77 


.35044X10-2 


. 79118X10-2 


37 


.38334X10-1 


. 13278X10-1 


78 


.24934X10-2 


.96411X10-2 


38 


. 22394X10-1 


. 74177X10-2 


79 


.16932X10-2 


. 13428X10-1 


39 


. 23827X10-1 


. 77759X10-2 


80 


.41795X10-3 


. 34892X10*1 


40 


. 23309X10- 1 


. 73372X10-2 


81 


.15111X10-2 


. 48004 



2 J. Kemeny, J. Snell, and G. Thompson, An introduction to finite mathe- 
matics, (Prentice-Hall, Inc., New York, N.Y., 1957). 



The number L was computed from eq (3.5) and 
gave 

1=39.22 (3.7) 

as the average length of the game. The same result 
was obtained by summing the series in (3.6). The 
machine computing time was 12 min for the former 
calculation and 15 min for the latter. 



4. Simulations 

The random element in the game of Chutes and 
Ladders arises from the toss of a die at each move. 
This was simulated in our work by employing the 
pseudo-random number generator of Taussky and 
Todd 3 . That is, a sequence of pseudo-random num- 
bers t^ t 2 , . . . , where 0<t t <l, were generated by 
the rules 



t j+1 = 2-* 5 rj 

r j+1 =5 15 r j (mod 2 35 ), r = 



,} 



(4.1) 



The unit interval was divided into six equal sub- 
intervals and the result of the jth die throw was iden- 
tified with the subinterval (first, second, . . ., sixth) 
in which tj fell. The game was then played N times 
on the calculator. The total number of throws 
necessary to play these N games was recorded as 
Df-iijj where L t denotes the length of each game. 
The average length of the game was then computed 
as (l/iV)Sf-iLf. Furthermore, the fraction of these 
games which finished in 31 or less throws was com- 
puted. For N=2 U the computing time was about 
45 min. The results of these calculations are given 
in table 3. 



Table 3. Results of the Monte Carlo calculations 



N 


i N 
i=l 


Fraction of 

games 
finished by 
31 throws 


32 


37. 469 
36. 969 
36. 117 
39. 480 
38. 701 
39. 521 
39.032 
39. 288 
39. 469 
39.420 

39. 224 


. 56250 


64 .. 


. 57813 


128 


. 55469 


256 


.46484 


512. _ 


. 49414 


1024 


. 47168 


2048 


.49072 


4096..- 


. 47974 


8192 


. 47693 


16384 _ 


. 47406 


Exact answer 


.48004 



5. Convergence 

We first show how (1/AOSf-i^ should converge to 
L=39.22. We introduce the distribution function 



f(n)=X sl (n)-X 81 (n-l). 



(5.1) 



3 0. Taussky and J. Todd, Symposium on Monte Carlo methods (John Wiley 
& Sons, New York, N.Y., 1956). 
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The mean oij(ri) is simply the average length of the 
game L as given by eq (3.4). Furthermore, the 
standard deviation for the distribution function j(n) 
is given by 

*=S (n-LY[X sl (n)-X 81 (n-l)]. (5.2) 

71 = 1 

The value of a for Chutes and Ladders was calculated 
according to (5.2) with L = 39.224 and the known 
values of X u (n)-X n (n-l). We found cr=25.222. 

Let L u L 2 , . . ., L N be regarded as a random 
sample of size N drawn from the population with 
distribution j(ri) where the moment generating func- 
tion of f(n) exists. It is well known 4 that even 
though f(n) is not normally distributed, the "sample 
mean" 1/JVy^iZ* has a population distribution 
which approaches a normal distribution with mean 
L and standard deviation c/ViVas N becomes infinite. 
Hence the probability is approximately .95 that the 
average length of play computed from the first N 
simulations lies in an interval centered at L with 
length 4c/ViV. This bound involves a, which has 
been computed in the case of Chutes and Ladders. 

In figure 1 the theoretical values of_L and a are 
used to plot the interval (L—2<j/-\>N, L+2a/-\!N) as 
a function of N. The values of ( i /A T ) X)f- A are a l so 
plotted and it is seen that they lie within our confi- 
dence interval. 
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Figuee 1. Convergence to L by U N~ 112 law." 



Now consider the probability of completing the 
game by a specified number of moves, say 31. If 
p=X 8 i(31), then the first N simulations can be re- 
garded as N Bernoulli trials for which the probability 
of success in a single trial is p. The probability of 
exactly v successes is given by the binomial distribu- 
tion 



* W. Feller, An introduction to probability theory and its applications (John 
Wiley & Sons, New York, N.Y., 1957). 



N\ 



v\{N-v)\ 



v v(l- v y- v (p=X 81 (3l), 0<v<N). 



(5.3) 



For large N, however, the fraction v/N of successes 
is approximately normally distributed with mean 
p and standard deviation ^p(l—p)/N. Approxi- 
mately 95 percent of the area under this normal 
curve lies in the interval 



P - ^p<ir p) <x< p+ 2M !^ p \ (5.4) 

and at least 95 percent lies in the larger interval 

Thus p can be estimated from v/N, as is illustrated in 
figure 2. 
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Figure 2. Convergence to X 81 (31) by u N~ in law" 



6. Existence of the Moments of f{n) 

In the previous section it was assumed that the 
moments 22% = \n k [X u {n) — X 81 (n—1)] exist for allZ:> 
1. If we expand X(n) in terms of the characteristic 
values of the matrix P (for example see Mont roll, 5 
p. 419) it follows that these moments will exist if P 
has X=l as the only eigenvalue with |A| = 1. How- 
ever, our Markov chain has one absorbing state 
which can be reached from any other state. The 
probability of reaching this absorbing state is inde- 
pendent of the initial state; but, this is a necessary 
and sufficient condition (see Gantmacher, 6 p. 93) that 



s E. Montroll, Markov chains, Weiner integrals, and quantum theory, Comm. 
Pure Appl. Math. 5, 419 (1952). 

6 F. Gantmacher, The theory of matrices, II (Chelsea Press, New York, N.Y., 
1959). 
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there exist only one eigenvalue with magnitude 1. 
Thus, the moments exist; also, the average length of 
the game can be defined by eq (3.6). 

7. Concluding Remarks 

The Monte Carlo calculations are in agreement 
with the theoretical results obtained from the mat rix 



calculations, and the convergence according to the 
"jy-i/2» J aws i s evident from figures 1 and 2. It is 
worth noting that the "iV~ 1/2 " convergence implies 
that if an additional significant figure is desired in a 
Monte Carlo calculation the computing machine 
time requirements are increased by a factor of 100. 

(Paper (54B4-36) 
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